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PREFACE 

In  previous  work  on  differential  approximation  by 
the  present  authors,  linear  time— invariant  differential 
equations  were  determined  that  minimize  least— square 
difference  criterion  functions,  and  successive  approxi¬ 
mations  were  obtained  by  means  of  quasilinearization 
techniques.  In  the  present  paper,  the  authors  consider 
the  analogous  problem  for  approximating  to  a  differential 
system  which  is  suspected  of  having  time— varying 
coefficients,  and  it  is  shown  that  the  same  method  is 
easily  extendible. 

Dr.  Roth,  a  Staff  Scientist  at  Avco  Corporation, 
Wilmington,  Massachusetts,  and  Mr,  Gluss  of  the  University 
of  California  at  Berkeley,  were  consultants  at  The 
RAND  Corporation  during  the  summer  of  1964, 


SUMMARY 


The  authors  consider  here  the  problem  of  obtaining 
an  optimal  fit  to  observed  data  by  determining  successive 
approximating  systems  of  linear  differential  equations 
with  time-varying  coefficients.  This  latter  characteristic 
introduces  little  additional  complexity  in  applying  the 
differential  approximation  and  quasilinearization  methods 
used  in  the  time— invariant  case.  Two  examples  are 
considered  in  order  to  demonstrate  the  method. 
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IDENTIFICATION  OF  DIFFERENTIAL  SYSTEMS  WITH 
TIME-VARYING  COEFFICIENTS 


1.  INTRODUCTION 

In  previous  work  on  differential— system  identification 
using  the  techniques  of  differential  approximation  and 
quasilinearization  (see^  for  example.  Refs.  [1—6]),  it 
has  been  assumed  that  the  system  under  consideration  was 
of  a  time— invariant  nature  that  gave  rise  to  an  output 
function  f(t)  in  the  time— interval  [0,T]  defined  by 
the  nonline.'T  differential  equation 

(1.1)  f^^^  -  G(f,f ',...,f^^^\t). 


with  initial  conditions 


(1.2)  -  Cj,  J  -  -  1. 


Methods  were  then  used  to  fit  a  linear  differential 
approximating  function  u(t),  that  is,  one  satisfying  a 
linear  differential  equation  of  the  type 


(1.3)  Uj,  +  -  0, 


where  u.  is  the  j— th  derivative  u'-^'''(t)  of  u(t), 
with  initial  conditions 
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(1.4)  ^  ■  0,1, . . . ,M  -  1. 

The  bj  and  Cj  were  chosen  in  such  a  way  as  to 
minimize  a  square— difference  criterion  function  of  the 
differences  between  the  theoretical  u(t)  and  the 
observed  f(t).  In  the  event  of  data  observed  only  at 
R  discrete  points  of  time  t^,  0  <  t^  <  t2  <  •  •  •  <  <  T, 

the  criterion  function  is 


(1.5)  [Uo(t^)  -  f(t^)]% 

while  for  continuously  observed  output  the  analogous 
function  is 


(1.6) 


T 

[uQ(t)  -  f(t)]^dt. 

0 


Even  though  in  this  time— invariant  case  the  bj  were 
considered  as  unknown  constants  which  had  to  be  determined, 
nevertheless  in  order  to  obtain  them  by  successive 

* 

approximation  using  quasilinearization,  the  device  was 
used  of  treating  them  as  additional  state  variables,  with 
differential  equations 


- ¥ - 

In  fact  it  is  partly  because  of  this  device  that  the 
extension  to  time-varying  systems  is  simple,  since  what  we 
are  doing  is  to  go  from  artificially  varying  state 
variables  or  coefficients  to  actually  varying  coefficients. 
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(1.7)  -  0. 

It  will  now  be  shown  in  some  simple  time— varying  cases 
that  these  methods  are  easily  extendible.  We  consider  two 
examples  involving  feedback «  which  are  related  to 
differential  systems  occurring  in  models  of  such  biological 
systems  as  the  respiratory  chemostat^  and  its  blood  and 
gas  flow,  in  which  the  time— varying  nature  of  the  systems 
have  up  to  now  had  to  be  ignored. 

2.  MODEL  I 

Suppose  that  f(t)  is  defined  by  the  "first— order" 
linear  differential  equation 

(2.1)  f'(t)  -  a(t)f(t)  +  b, 

where  the  coefficient  a(t)  is  itself  subject  to  the 
feedback  equation 

(2.2)  a(t)  ■  bQ  +  bj^f(t)  +  b2fj^(t)  +  •••  + 

where  (^)  ■  the  j— th  derivative  of  f(t). 

Or  alternatively,  in  the  interval  [0,T]  we  wish  to 
determine  a  function  u(t),  defined  by  constants 
b,bQ,bj^, . . .  by  initial  conditions 

(2.3)  u^(0)  “  Cj,  j  -  0,1, ...,k  -  1, 


and  by  differential  equations 


(2.4)  Uj^(t)  -  a(t)u(t)  +  b. 


where 


(2.5)  a(t)  -  bQ  +  bj^u(t)  +  b2Uj^(t)  +  •  •  •  -r 


that  minimizes  (Eq.  (1.5))  or  Sg  (Eq.  (1.6)). 

2.1.  Method  of  Solution 

Omitting  the  implied  time  variable  t,  we  first 
obtain  from  equations  (2.4)  and  (2.5) 

u,  -  b 

(2.6)  - bo  -  *’1“ - - 


[Continuity  of  the  first  k  derivatives  of  u(t)  will 
be  assumed  so  that,  for  example,  when  u  ■  0,  the  first 
term  on  the  right-hand  side  of  equation  (2.6)  is 

Uj^— b 

considered  to  be  lim  —7: — .  ] 


u-0 


u 


From  equation  (2.6),  if  we  now  use  the  device  of 


assuming  b,b«,...,b 


k+1 


to  be  state  variables,  we  arrive 


at  the  system  of  differential  equations 
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(2.7) 


■  u. 


u,  -  u. 


^-2 


u 

6 

b 


k-1 


u  h 

1  r^i  ~  ^ 

W  ^ 

0 


bo  -  b^v 


- -  W-i] 


0 


-  0 


\+l  “ 


If  we  now  put 


(2.8) 


r 


o 

X 

■ 

• 

• 

• 

1 

"  ^k-1 

'  b 

1 

“  ^k 

1  ^0 

“  ^k+1 

I 


^k+1  "  ^2k+2' 


then  the  nonlinear  system  of  differential  equations  in 
the  variable  x  ■  (Xq^Xj^,  .  • .  given  by 


(2.9)  X  -  £(x). 


or 


(2.10)  X  - 


1  r\  - 
^2k+2^ 


^k+1  ^k+2^0 


*  ‘  “  ^2k+l^k-l 


As  in  [6],  we  now  quasilineartze,  obtaining  successive 
solutions  ,  the  set  of  linear 

differential  equations  at  the  n—th  stage  being 


(2.11) 


1  —  '  n  ox  V  m  m 

0  m«0  ir. 


For  notational  convenience  in  what  follows,  we  now  put 


(n)  . 


(n-1) 


x'  ^  ■  y,  and  x'  “  x,  so  that  the  linear  system 
(2.11)  for  Y.  becomes 


.  2k+2  ^g.(x) 

(2.12)  Zj-gj(x)+  I  ^  (ym-V* 

•J  ^  msl  I  m 


From  equation  (2.10), 


<2-13)  - 


for  j  ■  0,...,k  —  2,  i  ■  0,.,.,2k  +  2, 


0  for  j  -  k,...,2k  +  2,  i  -  0,...,2k  +  2, 
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and 


(2.14) 


^8k-l 


(Xi  -  x^) 

’^2k+2  0 


^k-t-2 

^2k+2 


^gk-1  .  1  _  ^+3 

’^2k+2^0  ’^2k+2 


^^k-l  .  ^k-H4 
"3x2  ^2k+2 


^8k-l 

^2k-H 

^-1 

^2k+2 

^8k-l 

1 

^*k 

^2k+2’^0 

^8k-l 

1 

^k+1 

^2k+2 

^8k-l 

o 

1 

■ 

^^k+2 

^2k+2 

i  ^®k-l  _  ^k-2 

^^2k+l  ^2k+2 

I 

j  -  _  1  r^i  ^ 

^^2k+2  ^k+2 


^k+1 


^2k+l^k-2J* 


Hence  ecjuations  (2.12)  become 


(2.15) 


["1 


''k-l 

0 


where,  after  some  manipulation,  is  given  by 


(2.16) 


k-1 


X2k+2hl<i:'^l>  -  -  ,^o<>'j’'k+2+j  +  ’‘jyk+2+j> 


’'o 


yo 


(x^  -  x^) 


+  - 


(Yl  -  Yk) 


‘0 


^k+l  -  ^k+1 


^2k+2r^l  ’^k 


^2k+2^  ^0  "  ^k+2^0 


^2k+l\-l 


As  in  (1.5)  and  (1,6),  at  each  stage  we  detemine 
(2k  +  3)  independent  homogeneous  solutions  and  one 

particular  solution  for  equations  (2,15),  and  find 


the  linear  combination 
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(2.17) 


2k+2 


with  [dj]  such  that  or  Sg  is  minimized.  The 

procedure  is  precisely  as  in  the  time— invariant  case 
([5],  [6]),  to  which  the  reader  is  referred. 

After  determining  ^  (•  we  then  use  it  to 

find  same  way,  and  so  on. 

(As  in  [5],  [6],  the  and  are  found  with 

respective  initial  conditions 


(2.18)  ■  -2k+3 


and 


(2.19)  yp(0)  -  0, 

where  1.2k+3  +  3)  x  (2k  +  3)  identity  matrix.) 

3.  MODEL  II 

We  now  go  on  to  consider  a  second  model  which, 
although  conceptually  rather  more  complicated  than  Model  I, 
nevertheless  Introduces  no  additional  difficulties  and  is 
handled  in  much  the  same  manner. 

Suppose  now  that  instead  of  equations  (2.4)  and 
(2.5),  we  have 
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(3.1) 

Uj^(t) 

as  before 

,  and 

(3.2) 

a(t)  - 

Then  u. 

may  be 

(3.3) 

^  & 

But  a  ■ 

(u^  -  b 

(3.4) 

^  •  & 

a(t)  -  ca  +  +  bj^u  +  ^2^1  ^k+l'\' 


1  ‘‘2  “ 


-  ca  -  bo  -  b^u  -  •  •  •  -  b^u^_j 


^  ^UU2  -  ^li^i  “  b) 


c(u,  -  b) 


—  b^u  — 


-  \'\-i] 


Hence,  putting 


^0  "  ^0 


(3.5) 


I  ^-1  "  ^-1 

j  *’  -  ’S. 

‘’0  ■  >'k+l 


'’k+l  “  ’‘2k+2 
I  “  ’‘2k+3’ 


-li¬ 


ve  obtain^  as  for  Model  1,  the  nonlinear  system  of 
differential  equations 


(3.6) 


X 


^1 

*k-l 

1  ^0^2  ~  ^l^^l-’^k)  _  ^2k-h3^^1~^k> 

^2k+2  ^0 

"  ^k+2’'0  -  •  •  •  “  *2k+l’^k-l 

0 


0 


where  now,  of  course,  x  ■  (Xq,X|^ , . . .  ,X2|^^.2)  • 

The  iterative  systems  of  quasilinear  differential 
equations  are  obtained  precisely  as  before,  giving 


equations  similar  to  equations  (2.15)  with  hj^(y,x) 
being  replaced  by  h2(;^,x),  where 
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(3.7)  ^2k4’2^2  ^ 


k-1 


■  "  j^^^J*k+2+J  +  ’'jyk+2+i>  -  ^k+l  +  ^ 


Vo  ' 

x; 


+  -3  L-  XjXq  +  2xj  -  2x^x^  +  Xo>'l*2k+3  “  *0V2k+3. 


■0 
Vl 


] 


~i  Yu  r 

2xi  +  +  XqX2^^^3J  +  -j  L^l  ^0’'2k+3 

^0 

^k+2  ^9^2k+35_^l7^]i^, 

^2k+2  ^  x^ 


—  X 


k+1  “  ^k+2^0  -  •  •  •  -  X2k+1^-1 


-  x^)  +  V’^l^k  “  ^1  ^^0^2^ 

0  Xq 

^2k+3/  X 

“  ^^1  “  ^k^  “  ^k+1' 


From  here  onwards,  we  proceed  as  before. 

A .  CONCLUSIONS 

It  becomes  evident  from  examination  of  the  models 
considered  above  that  the  techniques  of  differential 
approximation  and  quasilinearization  applied  previously 
to  time— invariant  system  identification  may  also  be 
applied  widely  to  time-varying  systems. 

In  further  work,  we  shall  investigate  the  extension 
of  these  methods  to  differential— difference  systems. 


-13- 


REFERENCES 


1. 


2. 


3. 

4. 

5. 


Bellman,  R.  ,  A  Note  on  Differential  Approximation  and 

Orthogonal  Polynomials,  The  RAND  Corporation,  Rl<-3482-PR, 
March,  19637  - 


Bellman,  R.,  R.  Kalaba  and  B.  Kotkin, 

Approximation  Applied  to  the  Solution  of  Convolution 
Equations,  The  RANd  Corporat: 


Differential 

TT 


;T5h7  rof-3601-NIH,  May,  1963. 


Bellman,  R.  ,  H.  Kagiwada  and  R.  Kalabc*,  Quas il inear izati on . 
System  Identification,  and  Prediction,  The  RAND  Corpora- 
tion,  RM-3S12-PR,  August,  1963. 


Kalaba,  R.,  "Some  Aspects  of  Quasilinearization,"  Nonlinear 
Differential  Equations  and  Nonlinear  Mechanics,  Academic 
Press,  New  York,  1963 . 


Bellman,  R. , 
of  Systems 
Problems  Su 


B.  Gluss  and  R.  Roth,  On  the 
and  the  Unscramb ling  of  bata 


Identification 

■^nnrr 


poration. 


estcd  by  Neurophysiology, 
“ ‘'66— PR,  October,  1964. 


rhe  t 


Some 

Cor- 


Bellman,  R. ,  B.  Gluss  and  R.  Roth,  Segjnental  Differential 
Approximation,  The  RAND  Corpora tionj  RM-4269— 

October,  l964. 


6. 


